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ABSTRACT 

There is a continuing pressure on the p.S. civil 
Service Commission to provide greater job opportunities for 
Spanish-surnamed persons. The commission has been uroed to present 
recruiting literature, sample test material, and examination 
announcements in Spanish. This study investigated the effects of 
presenting verbal test material in an Enqlish-Spani sh format to ?07 
postal clerk-carrier applicants in San Antonio, Texas. Sixty-two 
percent of the applicants indicated that they spoke Spanish at home 
or at work at least 25^ of the time. Seventy-seven percent were high 
school graduates or had an equivalent education. The study indicated 
that, for persons educated in U.S. hioh schools, competence in 
written English is very likely to exceed or at least equal competence 
in written Spanish. The conclusions drawn from the investigation were 
(1) that providing bilingual test material for such aroups is of 
little help and (2) that, in a few individual cases where the 
educational level is low and the commitment to Spanish is hioh, there 
is some improvement over an initially poor score. { r «J) 
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Summa ry; 



Thio study investigated the effects on test score of presenting verbal teat 
material in an English end Spanish format, Ths population coneieted of 307 
Postal 0?.erk Carrier applicants in San Antonio, Texas, Sixty-two percent 
of the group Indicated that they spo^o Spauish at home or at work at least 
2 % of the time. Seventy-seven percent were high school graduates or it-e 
equivalent. 

For groups educated in U. S, high schools, c:.upetence in written English ia 
very likely to exceed or at least equal their competence in writ ten Spanish. 

•*** Consequently for such groups providing bilingual test 
material iy of little help, 

— T n a few individual caeca, where tho educational level 
is low end the conmivaient to Spanish high, some improve- 
ment over an initially poor score la achieved. 

The lack of improvement in using the EngliBh-Spanieh format would not 
necessarily apply in places such as Puerto Rico where schooling Is in a 
Spanish environment or for Jobs for which the applicant population la drawn 
fron the more poorly educated and has a very high commitment to use of Spanish. 



I. Background 

There la continuing pressure on the Civil Service Commission by various 
community action groups to provide greater job opportunities fox' Spanish 
surnamed persons. The Commission haa taken eorae steps in that direction 
in line with its program to improve its informational service to all 
segments of the work force. For example, it haa made use of the Spanish 
language in recruiting literature, in sample te3t material and in 
examination announcements. The further step of presenting the test 
questions in English-Spanish has also been urged based on the belief 
that the present teste inadequately measure the abilities of the Spanish 
surnamed competitors because of the language demands of the teste and 
that if the test questions were given in both English and Spanish, the 
language obstacle would presumably be avoided, A small-scale study 
along these lines was made by William Jasper in the San Francisco 
Region for a group of applicants for the Clerk-Carrier examination 
which indicated that providing test material in English and Spanish 
made little difference in test performance. Because of the critical 
nature of the issue, it wes decided to carry out a larger scale study. 

The Clerk-Carrier examination Is a particularly good vehicle to use in 
the study since it ip a nationwide program which provides a substantial 
number of entry level jobs at a reasonably good salary. If it worked 
here a considerable payoff in job opportunities could result. The plan 
was to put the verbal section of the Clerk-Carrior testa into an English* 
Spanish format and try it out in San Antonio, Texas, where Mexican- 
Americans make up a substantial part of the applicant population, 

II, Description of the Test 

The experimental edition of the new Clerk -Carrier battery made up of 
Address Checking, Memory, Number Series and Vtrbrl questions was used. 

The Verbal section was translated in the Central Office by an employee, 
fluent in Spanish, who had bean raised and educated in the Southwest. 

His drafts were sent to DsIIps for review to double check their suit- 
ability for use in that area. A third end fourth review were made by a 
professional translator and by a psychologist feailiar with test con- 
struction to insure that Enpliah and Spanish versions were equivalent 
as Judged by expert opinion. 

III. Population Tested 

The participants were 307 Clerk -Carrier rpplicante who appeared for 
testing on May 27, 28, and 29 t 1968, in San Antonio, Texas. They 
represented $ 0 % of the persons scheduled, about the normal "show* rate. 
All persons scheduled had been sent an English-Spanish version of the 
sample questions. A short questionnaire provided a few basic facts as 
to the sex, age, education and the extent of coaaitoant to use of 
Spanish (copy of questionnaire attached). These ere suxmerited below ! 
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Extent to which 
Spanish is Spoken 
at Home or at Work 






High (3/4 or more of the time) 


34* 


Medium (1/2 to 1/4 of the time) 


28* 


Low (None or very little) 

Total 


J£| 

100* 




Less than H. S. graduate 


23* 


H. S. giad. or equiv. 

Total 


J?21 

100$ 







Malo 


m 


Female 


31* 

100* 



The San Antonio group represents a "good” applicant population. It is 
fairly young with a at d lan age under 25 and only 20* 30 or over. Seventy- 
seven percent are high uehool graduates or have earned its equivalent, 
suoh as GBD certificates. Hie quality of the population is demonstrated 
by the faot that tho eligibility rate in San Antonio has been 60*64$. 

This coapares favorably with cost areas of the country* Apparently, 

Post Office jobs are still attractive in this part of the country to 
the young high school graduate. Nevertheless, the extent of Spanish 
usage aede this s suitable study group. 



IV* Study Plan 



The effect on test performance of providing Engllsh-Spanish material 
was to be evaluated on the basis of the scores on the 30 verbal items— 

20 vocabulary and 10 reading. Three different arrangements of the 30 
Items were assembled and labeled Series A, B, and C. 

Series A — lne 30 questions are given first In English 
and then repeated In Engllsh-Spanish where 
each question appears in both languages side 
by side on the test page. 

Series B — The 30 questions are given first Jn English as 
in Series A but then repeated again in English. 

This is to provide a measure of how much gain 
results by just repeating the same questions. 
(Competitors who took Series B were invited to 
take the Engllsh-Spanish version later but none 
felt it necessary.) 

Serlus C — Tho 30 questions are given first in the English- 
Spanish format and then repeated in English only. 

The three series were lnterleafed in packaging in the ratio of 4 A's 
to one B and one C» and distributed in the examination room as packaged 
to give a random distribution of sories. Complete tests and question- 
naires were obtained for 307 competitors in the following numbers: 

Series A - 205 Engl Ish-Engl lah/Spaniah 

B - 51 English-Engliah 

C - 51 EnglieVSpanish-English 

The time limit of 30 minutes for each administration of the 30 verbal 
items enabled all but very few to try all the items in both the initial 
test and the retests. 

V. & 

Is there a gain in a core on Engllsh-Spanish test material? 

Table 1 ausat&rites the group results means and (standard deviations) 

for IKe* two administrations of each or the three series, maximum score = 30. 
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Mean and Standard Deviation by Series 







Series A (N=205) 


Series 8 i/ (N-51) 


Series C (N=51) 


Administration 


1st 


Eng. 18.8 (5.7) 


Eng. 17.7 (5.5) 


Eng.** 18.8 (4.4) 
Span, . 




2nd 


Eng.- 19.1 (5.5f 
Span. 


~Eng, 17.9 ( 5 . 7 ) 


Eng. 18.8 ( 4 . 8 ) 


Difference 




+.3 


+.2 


0 



The data in Table 1 show the change in scores between the 1st and 2nd 
administration for each of the three sei'ies. The lack of any signifi- 
cant improvement in the mean scores for Series A supports the position 
that for these competitors as a group the English -{Spanish format was of 
no advantage. In other words persons who took Series A for all practical 
purposes did no better than those taking Series D in which the same 30 
questions are repeated in English. 

In Jasper's study two samples of competitors were compared on a single 
administration of English and English-Spanish test material. One group 
took English only and the other group took the English-Spanish version. 

A comparable comparison can be made hero by combining those who took 
Series A end Series ^ in which the first administration is in English 
with those who took Series C in which the first administration is in 
English-Spanish. 

The mean score for the combined Series A and Series 1 groups is 18.6, 
for the group taking Series C the mean is 18.8. As in Jasper's study, 
the difference Is of no consequence for the groups as a whole . 

Is. the value of En glish-Spanish, mat erial dependent on_educatlon. aM 
extent of use of Spanish? 

It is reasonable to assume that those likely to be helped most by the 
Spanish material would be those who were not highly educated in foglish 
and who had a heavy commitment to Spanish. The relatively high level of 
schooling of this competitor population would tend to lessen the value 
of the Spanish material and therefore Individual lnatenceo of substantial 
improvement could be obscured by the group effect. To explore this issue, 
the "A* Series competitors (Eng. /Engl Lsh-Spenleh) was subdivided on the 
basis of education and the extent to \*>ich the competitor npoke Spanish 
at home or at work. 



1 / The correlation (r) between the first end second administrations of 
Series 8 is .95. 



Table 2 shows the mean test scores for the several combinations of education 
and extent of Spanish spoken. 



Table 2 



Teat Performance of Subgroups of Those Taking Series A 



• 


N 


Administration 


Diff. 


Standard 
error of 
Diff. 


1st 


2nd 


(Eng.) 


(Eng.- 

Span.) 


a) H. S. Grad,-*Spenish High 


51 


17.8 


18.1 


+.3 


.3 


b) Non-H. S, Grad .-Spanish High 


19 


12.5 


13.2 


+.7 


.6 


o) H. S. Grad. -Spanish Medium 


36 


19.3 


19.9 


+.6 


.3 


d) Non-H. S, Grad. -Spanish Medium 


15 


17.3 


17.1 


-.2 


.5 


e) H. S. Grad, -Spanish Low 


76 


21.3 


21.5 


+.2 


.2 


f) Non-H, S. Grad, -Spanish Low 


8 


16.8 


16.9 


+.1 


.5 



The gains are not impressive and confirm the conclusion from Table 1 that 
the Spanish material adds little to the test performance for these competitors. 
However the data do show that high school graduates, lines a, c end a, do 
better than non-high school graduates, lines b, d and f, and that extensive 
use of Spanish is associated with poorer test performance for persons with 
the same level of education. The highest performance group comprises the high 
school graduates who apeak either ver/ little or no Spanish (line e) s the 
lowest performance, the "less than high sohool graduates" who speak Spanish 
extensively (line b). 

In summary > those who d'd poorly in English tended to repeat their poor 
performance even when the material was available In Spanish. 

Are there many individuals who profit greatly from Spanish test material? 

Another way of looking at the date la to study the changes in test score by 
individuals. An increase of 4 points or more can be regarded as substantially 
outside the range of what could be expected (If level) by simply opeating 
the teat. V 



1 ha standard error of measurement of an Individual's score as established 
from Group B is 1,3 points. 
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Table ^ 



Number Making the Specified ChangeB in Test Score between 
1st end 2nd Administration by degree of use of Spanish 



Series 


Use 

of 

Spanish 


N 


Change in score points 


(-4) or more 


(-3) — (+3) 


(+4) or more 




High 


70 


2 


63 


5 


A 


Med. 


51 


1 


46 


4 




Low 


84 


— 


82 


2 




All 


205 


3 


191 


11 


B 


All 


51 


2 


48 | 


1 1 



For the 51 who repeated the English twice (Series B), 1 person increased 
hie score by 4 or more points and 2 persons decreased theirs by 4 or 
mors points. 



Anorg the 205 who took Series A, the English first and then the Erglleh- 
Spauish, 11 persons increased their score by 4 or more points, 3 persons 
decreased it by same amount. Eleven persons gaining 4 score points ere 
nw.’e than would be expected by chance among a group of 205* Those 
persons ware primarily from among those who had indicated a "medium" 
to "high" uee of Spanish. (An unexpected illustration of this finding 
ie that the largest increase of all points was made by a Mexican national, 
vlo hud recently immigrated to the (J. S.) In terms of individual gains, 
the daoa indicate that /*or a few persons providing the questions in 
Spanish is helpful. However this help is relatively minimal when the 
population is predominantly young high school graduates. 



VI. 



A sizable difference apparently ox lets between the group's knowledge 
of Spanish as an oral language and Spanish as a written language. 
About 50# indicated that they spoke Spanish "without difficulty," 
whereas only 15^ indicated they could read and understand a Spanish 
newspaper "without difficulty." Even this 15jJ, with few exceptions, 
rated themselves bettor able to read and understand e newspaper in 
English than in Spanish. Apparently, many apeak colloquial Spanish 
("Tex-Mex") at home or on the street or ot work, but have little 
occasion to use the written language. Ibis suggests why for such 
groups little gain can be expected by providing written material in 
both English and Spanish ovsr what is schleved by English alone. 

- 7 - 




Perhaps the atuver to the language problem in the tests depends on our 
efforts to keep the language level in line with language demands of the 
Job both in terms of Job tasks and in terms of the oilier demands on the 
employee to communicate in English in the work environment. In that 
way, ability to use the English language becomes a job related require-” 
raent and its measure can be justified on the same basis as any other 
ability essential to performing the Job. To carry this principle into 
praotlce, in the new Clerk-Carrier test, the verbal score requirement 
is set at the minimum language level sufficient -to neat Job demands. 

This study, as well as others, oupportj the conclusion that if th9 
competitive population is predominantly made up of persons educated 
in U. S. high schools (not necessarily H. S. graduates) their competence 
in written English is very likely to exceed or at least equal their com- 
petence in written Spanish. For such groups, (typical of Clerk-Carrier 
applicants) presenting test questions in Spanish is of negligible value. 



QUESTIONNAIRE FOR APPLICANTS FOR 
EMPLOYMENT IN THE POSTAL SERVICE 



The Civil Service Commission is studying 
ways to make its examinations as fair as 
possible for all competitors. Your 
answers to the questions will help us in 
this work. Your answers will not affect 
your rating or your chances for a job in 
any way. They will be used by the CSC 
for research studies only. However, if 
there are any questions you do not wish 
to answer, you may leave them blank. 
Please fill out the questionnaire 
carefully. Thank you. 



CUESTIONARIO PARA CANDIDATOS A EKPLSOS 
EN EL SBRVICIO POSTAL 



La Civil Service Commission est^ buscando 
via forma de preparar y dar sus ex/menos 
con la mayor justicia posible para todos 
los candidatos. Sus respuestas a las 
preguntas nos ayudaran en esta tarea. 

Sus respuestas no afectaran en forma 
alguna ni su calificaci^n ni sus opor- 
tunidades de obtener un empleo. La CSC 
las utilizer/ wiica- y exclusivamente en 
estudios cientificos. Sin embargo, si 
hubiera alguna pregunta que usted no 
deseara contestar, puede dejarla en bianco. 
Le rogamos que llene el cuestionario 
cuidadosamente. Muchas gracias. 



1. Name: 



2. Place of birth: 

£7 u.s.a. £7 Mexico 

D other 






Highest grade in school completed 
outside of the United States: 



3. Sex: 



f~l Male 
4. Age: 

/~1 19 or less 

O 20“29 

£7 30-39 
O 40-49 
O 50-59 

Q 60 or older 



n Female 



5. Highest grade in school completed 
inside the United States: 



n Pid not attend any school inside 
the United States 



O ^th grade or less 
. O 9th, 8th or 9th grade 
n 10th, llth or 12th grade but did 



not graduate from high or 
secondary school 



£7 High school graduate, its 
equivalent or higher 



£7 Did not attend school outside 
of the United States 



Q 6th grade or less 

n 7th, 8th or 9th grade 

O 10th, llth or 12th grade but did 
not graduate from high school 



£7 High school graduate, its 
equivalent or better 



7. 



How muc Spanish do you speak? 
A. In your home — 

£7 Very little 
£7 About 1/4 of the time 
fl About 1/2 of the time 
£7 About 3/4 of the time 
£7 Almost all the time 



B. Outside of home (including at 
work) — 



CO TO #6 



fl Very little 
£7 About 1/4 of the time 
£7 About 1/2 of the time 
£7 About 3/4 of the time 
£7 Almost all the time 
CONTINUE TO NEXT PACE 



8. How do you rate your knowledge of 
Spanish? 

A. Read and understa nd a Spanish 
newspaper — 



9 . How do' you rate your knowledge of 
Spanish as compared with your 
knowledge of English? 

A. Read and understand a newspaper— 

in Spanish better 
about the same 
in English better 

B. Speak — > 

Spanish better 
about the same 
English better 

C. Carry on a conversation — 

in Spanish better 
about the same 
in English better 



8, Como clasificaria sus conocimientos 
de espanol? 

A. Leer comprender un diario en 

espanol-- ; 

con raucha dificultad 

con cierta dificultad pero se 
desenvuelve 

sin ninguna dificultad 

B. Hablar espanol — 

con mucha dificultad 

con cierta dificultad pero se 
desenvuelve 

sin ninguna dificultad 

C. Conversar con alguien que hable 
y comprenda lini'camente espanol— 

con mucha dificultad 

con cierta dificultad pero se 
desenvuelve • 

sin ninguna dificultad 

9. C&no clasificaria sus conocimientos 
de espanol si los compare con sus 
conocimientos de ingles? 

A. Leer y comprender un diario — 

CJ mejor en espanol 

O aproximadamente igual 

D mejor en ingles 

B. . Hablar — 

o mejor en espanol 

o . aproximadamente igual 

/~1 mejor en ingl/s 

C. Conversar — 

n mejor an espanol 

O aproximadamente igual 

o .mejor en ingle's 



with much difficulty a 

with some difficulty but can get 

by ' 

with no difficulty at all /~7 

B. Speak Spanish — 

with much difficulty £J 

with some difficulty but can get f~l 

by . 

with no difficulty at all f~} 

C. Carry on a conversation with someone 
who speaks and understands only 
Spanish — 

with much difficulty f~l 

with some difficulty but can get /~7 

by 

with no difficulty at all f~) 



